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Abstract: We propose a systematic method to directly identify a sensor fault estimation filter 
from plant input/output data collected under fault-free condition. This problem is challenging, 
especially when omitting the step of building an explicit state-space plant model in data-driven 
design, because the inverse of the underlying plant dynamics is required and needs to be stable. 
We show that it is possible to address this problem by relying on a system-inversion-based 
fault estimation filter that is parameterized using identified Markov parameters. Our novel 
data-driven approach improves estimation performance by avoiding the propagation of model 
reduction errors originating from identification of the state-space plant model into the designed 
filter. Furthermore, it allows additional design freedom to stabilize the obtained filter under 
the same stabilizability condition as the existing model-based system inversion. This crucial 
property enables its application to sensor faults in unstable plants, where existing data-driven 
filter designs could not be applied so far due to the lack of such stability guarantees (even 
after stabilizing the closed-loop system). A numerical simulation example of sensor faults in an 
unstable aircraft system illustrates the effectiveness of the proposed new method. 

Keywords: Filter design from data, fault estimation, system inversion. 


1. INTRODUCTION 

Model-based fault diagnosis techniques for linear dynamic 
systems have been well established during the past two 
decades (Chen and Patton, 1999; Ding, 2013). However, 
an explicit and accurate system model is often unknown in 
practice. In such situations, a conventional approach first 
identifies the plant model from system input/output (I/O) 
data, and then adopts various model-based fault diagnosis 
methods (Simani et ah, 2003; Patwardhan and Shah, 2005; 
Manuja et ah, 2009). Without explicitly identifying a 
plant model, recent research efforts investigate data-driven 
approaches to directly construct a fault diagnosis system 
for additive sensor or actuator faults by utilizing the 
link between system identification and the model-based 
fault diagnosis methods (Qin, 2012; Ding, 2014a). These 
recent direct data-driven approaches simplify the design 
procedure by skipping the realization of an explicit plant 
model, while at the same time allow developing systematic 
methods to address the same fault diagnosis performance 
criteria as the existing model-based approaches. 

Existing methods for data-driven fault detection and iso¬ 
lation construct residual generators with either the par¬ 
ity vector/matrix (Ding et ah, 2009) or the Markov pa¬ 
rameters (or impulse response parameters) (Dong et ah, 
2012a,b) that can be identified from data. Compared to 
generating residual signals sensitive to faults, fault esti¬ 
mation is much more involved. Dunia and Qin (1998) and 
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Qin (2012) proposed to reconstruct faults by minimizing 
the squared reconstructed prediction error in the resid¬ 
ual subspace of a latent variable model. However, fault 
reconstructability of this approach was limited by the 
dimension of the residual subspace, especially when using 
a dynamic latent variable model (Dunia and Qin, 1998). 
Chapter 10 of Ding (2014a) first constructed a diagnostic 
observer realized with the identified parity vector/matrix, 
and then addressed faults as augmented state variables. 
This augmented observer scheme, however, imposed cer¬ 
tain limitations on how fault signals vary with time. In con¬ 
trast, Dong and Verhaegen (2012) constructed a system- 
inversion-based fault estimator using the identified Markov 
parameters, without any assumptions on the dynamics of 
fault signals. The drawback of this system-inversion-based 
method is that it cannot be applied to sensor faults in an 
unstable open-loop plant because its underlying system 
inverse used for the data-driven design is unstable in this 
case. In order to address this above drawback, we have 
recently proposed a receding horizon fault estimator by 
following a least-squares (LS) formulation of the fault 
estimation problem, and developed an H 2 /iFoo optimal de¬ 
sign to compensate for identification errors of the Markov 
parameters (Wan et ah, 2014b). This receding horizon 
method processes a batch of measurements at each time 
instant, thus may require increased computational effort. 

This paper focuses on the direct data-driven design prob¬ 
lem for a sensor fault estimation filter. This problem is 
challenging, especially when omitting the step of building 
an explicit state-space plant model in data-driven design, 
because the inverse of the underlying plant dynamics is 



required and needs to be stable. In order to pave the way 
for the data-driven design, we first construct a system- 
inversion-based fault estimation filter based on the dynam¬ 
ics of the one-step-ahead predicted residual signal. The 
system inverse is divided into two parts: the open-loop left 
inverse, and the feedback from the residual reconstruction 
error to stabilize the inverse dynamics. This turns out to 
be stabilizable as long as the subsystem from faults to 
the outputs has no unstable invariant zeros. Our data- 
driven design method is obtained by parameterizing the 
above two parts of the inverse dynamics with the predictor 
Markov parameters identified from data. 

Compared to the model-based approach based on an iden¬ 
tified plant model, our direct data-driven design improves 
estimation performance by avoiding the propagation of 
model reduction errors originating from identification of 
the state-space plant model into the designed filter. More¬ 
over, our proposed new method allows additional design 
freedom to stabilize the obtained filter under the same 
stabilizability condition as the existing model-based sys¬ 
tem inversion. This important additional property enables 
its application to sensor faults in unstable plants, where 
existing data-driven filter designs (Dong and Verhaegen, 
2012) could not be applied so far due to the lack of such 
stability guarantees (even after stabilizing the closed-loop 
system). We also analyze the relationship between our 
novel data-driven design described in this paper, and our 
recently proposed moving horizon fault estimation method 
in Wan et al. (2014b). The presented new data-driven 
filter achieves better computational efficiency at the cost 
of minor performance loss and a more strict condition 
required for unbiasedness. The above significant advances 
to the state-of-the-art in data-driven fault estimation are 
illustrated via a numerical simulation example of an un¬ 
stable aircraft system. 

2. PRELIMINARIES AND PROBLEM 
EORMULATION 

2.1 Notations 


2.2 System description 

We consider linear discrete-time systems governed by the 
following state-space model: 

-b 1) = A^{k) + Bu{k) + Ef{k) + Fw{k) 
y{k) = C^ik) + Du{k) + Gf{k) + v{k). ^ ^ 

Here ^(k) € M", y{k) G and u(k) G M"" repre¬ 

sent the state, the output measurement, and the known 
control input at time instant k, respectively. The pro¬ 
cess noise w{k) G and the measurement noise 

v{k) G K"’' are white zero-mean Gaussian, with covari¬ 
ance matrices E (w(fc)w"'’(A:)) = Q, E (^v{k)v'^(k)) = R, 
E (^w{k)v'^(k)) = 0. f{k) G is the unknown fault signal 
to be estimated. A, B, C, D, E, F, G are constant real ma¬ 
trices, with bounded norms and appropriate dimensions. 

The following assumption is standard in Kalman filtering 
(Kailath et ah, 2000) and subspace identification (Chiuso, 
2007a,b): 

Assumption 1. The pair {A, C) is assumed detectable; and 
there are no uncontrollable modes of {A^FQ^) on the 
unite circle, where Q ^. (Q5 )'^ = Q is the covariance matrix 
of w{k). 

We consider additive sensor faults in this paper, i.e., 

A = 0„,xi, G = /M (5) 

for faults of the j**' sensor, with representing the 
j**' column of a matrix X. As in Dong and Verhaegen 
(2012), we adopt the following common assumption for 
sensor faults: 

Assumption 2. rank(G) = n/. 

For data-driven design without knowing the system matri¬ 
ces in (4), it should be noted that in practice data collected 
under faulty conditions may be seldomly available, or if 
recorded then without a reliable fault description (Ding, 
2014b). Hence we make the assumption as below: 
Assumption 3. Only I/O data collected under the fault- 
free condition are used in our data-driven design. 


For a matrix X, X~ represents the left inverse satisfying 
X~X = I, and XA) represents the generalized inverse 
satisfying 

XX^X = X. (1) 

The z**' column of X is denoted by X W. For the state-space 
model {A, B, G, D) or the sequence of Markov parameters 
Hq,F[i,--- let Ol and 71 denote the extended 

observability matrix with L block elements and the lower 
triangular block-Toeplitz matrix with L block columns and 
rows, respectively, i.e.. 


Ol (A,G) = 


r c 1 

CA 


■ Ho 

0 

.. 0 ■ 

,rL({i7j) = 

Hi 

Ho 


.CA^-^ . 


. Hl-1 

Hl-2 ■■ 

-1 

o 


or Tl (A, H, G, D) = 


D 

CB 

aL-2 , 


0 

D 


-CA^^-^B CA^-^B ■■■ L 

E represents the mathematical expectation. 


( 2 ) 

( 3 ) 


No assumption is made in this paper about how the fault 
signals f{k) evolve with time. 

2.3 Problem formulation 

With Assumption 1, the system (4) admits the innovation 
form given by 

x{k -b 1) = Ax{k) -b Bu{k) -b Ef{k) + Ke{k) , , 
y{k) = Gx{k) + Du{k) + Gf{k) + e{k). 

where K is the steady-state Kalman gain, {e{k)} is the 
zero-mean innovation process with the covariance matrix 
Eg. Then e(fc) can be eliminated from the first equation of 
(6) to yield the one-step-ahead predictor form 

x{k -b 1) = ^x{k) + Bu{k) + Ef{k) + Ky{k) . . 
y{k) = Gx{k) + Du{k) -b Gf{k) + e(fc), 

with $ = A - KG, B = B- KD, and E = E - KG. The 
sensor fault direction matrices E and G in the predictor 
form (7) can be explicitly written as 

E = -K^^\ G = 7l^'l (8) 

for faults of the sensor according to (5). 



Denote the predictor Markov parameters by 


Hf = 


h! = 


D i = 0 

i > 0 

G i = 0 

C<i>^-^E i > 0 


= 


0 


i = 0 
K i>0 


( 9 ) 


With access only to the closed-loop data collected under 
the fault-free condition, the conventional model-based 
approach needs to identify the state-space model (7) for 
the fault estimation filter design. Such an identification 
algorithm follows three steps: (i) consistent LS estimation 
of the sequence of Markov parameters related to the fault- 
free subsystem (<f>, [B K] ,C,[D 0 ]), i.e., 

e=[h; ny ■■■ H! H^]; (lo) 

(ii) state-space realization of the fault-free subsystem 
(d), [b K] ,C,[D 0]); (iii) construction of the fault di¬ 
rection matrices E and G according to (8). The first 
two identification steps above can follow the predictor- 
based subspace identification (PBSID) method in Chiuso 
(2007a,b). With the identified state-space model, existing 
model-based design approaches can be adopted. A disad¬ 
vantage of the above design procedure is that the model 
reduction errors introduced in the state-space realization 
step would propagate into the fault estimation filter and 
might result in large fault estimation errors. 

In order to avoid propagating the above model reduction 
errors into the designed filter, this paper aims to directly 
construct a stable sensor fault estimation filter with the 
Markov parameters S identified from data. 


3. SYSTEM-INVERSION-BASED FAULT 
ESTIMATION FILTER USING PREDICTOR FORM 


As the foundation for our data-driven design, we construct 
a system-inversion-based fault estimation filter in this 
section using the state-space model of the predictor (7). 

3.1 Open/Closed-loop left inverse 

From (7), we construct a residual generator as follows: 
x{k -b 1) = ^x{k) -b Bu{k) -b Ky{k) 
r{k) = y{k) — Gx{k) — Du{k), 
whose residual dynamics is 

x{k -b 1) = -b Ef{k) 

r{k) = Gx{k) -b Gf{k) -b e(fc), 
with x(k) = x{k) — x(k). 

By multiplying (I2b) with G~, it follows that /(fc) can be 
reconstructed as 


f{k) = G- {r{k) - Cx{k) - e{k)). 
Substituting the above equation into (I2a) then yields the 
following left inverted system: 


x{k -b 1) = ^ix{k) -b Bi {r{k) — e{k)) 

(13a) 

f[k) = Gix{k) -b Di (r(fc) - e{k)) 

(13b) 

with 


$1 = 4.- EG-C, Bi = EG-, 

(14) 

Cl = -G-C, Di = G-. 

(15) 

Since the innovation signal e(fc) and the initial state a;(0) 
are unknown, we construct the following system based on 


( 11 ) 

(I2a) 

(12b) 



Fig. I. Structure of the closed-loop left inverse 

the inverted system (13) by ignoring e{k) and replacing 
x{k) and f{k) with the state estimate Xr(k) and the fault 
estimate f{k): 

Xr{k1) = ^iXr{k)Bir{k) (16a) 

f{k) = CxXr{k) -b D^r{k). (16b) 

It is desired that the left inverse (16) is stable such 
that, starting from any arbitrary estimate 2 :^( 0 ) of the 
initial state a:(0), unbiasedness of the estimates Xj.{k) and 
f{k) can be achieved asymptotically. However, it is not 
guaranteed that the left inverse (16) is stable. 

Next, we stabilize the inverted system (16) by feeding the 
residual reconstruction error back into (16a). Based on the 
state estimate Xr{k) and the fault estimate f{k) in (16b), 
the residual signal r(k) can be reconstructed as 

f{k) = Gxr{k) -b G {CiXr{k) + i:>ir(fc)) 

= G2Xr{k)-\-D2r{k) (17) 

according to (12b), with 

C2 = {I- GG-) C, D2 = GG-. (18) 

Then we construct the following closed-loop left inverse by 
feeding the residual reconstruction error r{k) — r(k) back 
into the open-loop left inverse (16): 

Xr(k -b 1) =^iXr{k) -b i?ir(fc) -b {r{k) — f{k)) 

=^2Xrik)-i-B2r{k) (19) 

f{k) =GiXr{k) -b Dir{k) 

with 

<^>2 = <^>1 - KrC2, B2 = Bi + Kr {I - D 2 ) . (20) 

Here “open-loop” and “closed-loop” refer to the ab¬ 
sence/presence of the feedback from the residual recon¬ 
struction error in the two inverted systems (16) and (19). 
The structure of the closed-loop left inverse is illustrated 
in Figure 1. 

It is worth noting that the data-driven filter design in Dong 
and Verhaegen (2012) considered only the open-loop left 
inverse whose stability is not guaranteed. It should also 
be pointed out that similarly to the simultaneous state 
and input estimation filter proposed in Gillijns (2007), 
the closed-loop left inverse (19) produces both the state 
estimate Xr{k) and the fault estimate f{k). However, the 
proposed closed-loop inverse (19) has a more structured 
formulation, i.e., the combination of the open-loop left 
inverse and the feedback from the residual reconstruction 
error. Such a formulation enables our data-driven design 
in Section 4. 






3.2 Stabilizability and unbiasedness 

By defining Xr{k) = x{k) — Xr{k) and j{k) = f{k) — f{k), 
we can obtain the dynamics of the fault estimation error 
as 

Xr{k + 1) = $2ir(fc) — i? 2 e(fc) 

= ($1 - Kr.C2) Xr{k) - B2e(k) ( 21 ) 
/(fc) = CiXr{k) — Die{k) 

according to (12), (14)-(15), and (19)-(20). Therefore, 
if ($ 1 ,( 72 ) is stabilizable, there exists a stabilizing gain 
Kr in (21), such that the obtained fault estimates are 

asymptotically unbiased, i.e., lim E {f{k)) = 0. 

k^oo \ / 

Theorem 1. ($ 1 ,( 72 ) is stabilizable if the fault subsystem 
($, E, C, G) has no unstable invariant zeros. 

The proof is given in Appendix A. 

3.3 Fault estimation filter 


So far we have constructed the closed-loop left inverse (19) 
to estimate faults from the residual signal generated by 
(11). By cascading the residual generator (11) and the 
closed-loop left inverse (19), we obtain the following fault 
estimation filter that produces fault estimates from the 
system inputs and outputs: 


Xr{k + 1) 


$2 

-B 2 C 

Xr{k) 

1 

—B 2 D B 2 

x{k + 1) 


0 

$ 

x(k) 


B K 




f{k) = [Cl -D^C] 


r{k) 

Kk) 


[-DiD Di]z{k) 


( 22 ) 

where 

z{k) = [u'^ik) y'^ik)] . (23) 

With Xf{k) = Xr{k) -\- x{k), the above fault estimation 
filter (22) can be reduced as follows by eliminating the 
unobservable modes: 

Xf{k -b 1) = ($1 — KrC2)xf{k) + {Bf — KrDf^2) u{k) 

+ {Kf + KrGf,2)yik) 


f{k) =GiXf(k) -b Df^iulk) -b Diy{k), 

(24) 

where $ 1 , (7i, Di and C 2 are dehned in (14), (15), and 
(18), respectively, and 

Bf=B-EG-D, Df ^2 = {I -GG-) D, (25a) 

Kf = K + EG-, Gf ^2 = {I-GG-), (25b) 

D/,! = -G-D. (25c) 


4. FAULT ESTIMATION FILTER DESIGN USING 
MARKOV PARAMETERS 


In this section, we propose our Markov-parameter based 
design of the fault estimation filter (24) by exploiting its 
extended form over a time window. 

4.1 Extended form of the fault estimation filter 

With fco = k—L+1, define stacked data vectors in a sliding 
window [ko, k] as Zk^L, T^k,L, tk,L, and e^^L, respectively for 
the signals z, r, /, and e, e.g., 

2k,L = [z'^ (ko) ■ ■ ■ z'^ (k)]'^ . (26) 


Define and Tf as the lower triangular block-Toeplitz 
matrices, i.e., 

T{=rL($,A,C,G),Ti=rL($,[.B K],-G,[-D /]), 

(27) 

with Ol and 7i defined in (2) and (3). According to (11) 
and (12), the stacked residual signal ^ over the time 
window [ko, k] can be written in the extended form 

rfc.L = Cl ($,-C) • i(fco)-b 

= Cl ($, C) • x(fco) + + efc,i 

where Zk^L is defined in (26), and z{k) is defined in (23). 

By assuming the initial state Xr{ko) = 0 in the closed-loop 
left inverses (19), the stacked fault estimates ik,L over the 
time window [fco, k] can be written in the extended form 

h,L = ICl ■ rfc,L with K.l=Tl ($ 2 , B 2 , Ci,Di). (29) 

With tedious but straightforward manipulations, the 
block-Toeplitz matrix 1C l defined in (29) can be rewritten 
as 

ICL = GL+ML[l-TiGL), (30) 

where 

^L =rL($i,Bi,Ci,Di), (31) 

ML=TL{^l-KrC2,Kr,Gi,0). (32) 

By substituting (30) into (29), the extended form (30) can 
be intuitively explaned: 

(i) Gb^k.L is the stacked fault estimates from the open- 
loop inverse (16); 

(ii) T{lJLrfc,L is the stacked reconstructed residuals gen¬ 
erated by (16a) and (17); 

(hi) A1L represents the feedback dynamics from the 

stacked residual reconstruction errors T{lJLrfc,L 
to the stacked fault estimates. 

By substituting (28) and (30) into (29), we obtain the 
following extended form of the fault estimation filter (24): 

ffe,L = Cl ($ 2 , Cl) • x(fco) -b [TCl + MlQl) ■ Zfc.L, (33a) 
= Cl ($ 2 , —Cl) • x{ko) + ik,L + ICr^k.L (33b) 

with 

7 ^L = ^L • Ti = Tl ($ 1 , [Bf Kf],C,, [D/.i Di]), 

Ql = (/ - tIGl) ■Tl=Tl- t{77l (34) 

= rL ($!,[% Kf],-G 2 d-Df ,2 Gf, 2 ]). 

The derivation of TT-l in (34) is obtained by regarding 
Gl ■ Tf^ as cascading the system ($, [ R K ], —C, [ —D /]) 
related to Tf and the system ($i, Ri, Ci, Di) related to 
Gl- Similar methods apply to the derivation of Ql in (34). 

It can be seen from (33b) that f^^L is a biased estimate 
of fk,L due to the presence of unknown initial state 
i(fco). However, it follows from (33b) and the definition 
of Cl ($ 2 ,—Cl) in (2) that 

E (/(fc) - /(fc)) = -Ci$^-ii(fco), 

where f{k) and f{k) are the last Uf entries of f^^L and 
ffe,L, respectively. The above equation shows that f{k), 
extracted from l in (33a), gives asymptotically unbiased 
fault estimation as L goes to infinity if $2 is stabilized 
given the condition in Theorem 1. 



4-.2 Markov-parameter based design 


In order to avoid propagating model reduction errors that 
originate from the identification of the state-space plant 
model into the designed filter, we now directly construct 
the sensor fault estimation filter (24) from data by utilizing 
its extended form (33a). The basic idea follows four steps: 


(i) Identify the Markov parameters S in (10) using the 
plant I/O data (Chiuso, 2007a,b); 

(ii) Compute the Markov parameters of the system 


(<&!,[% Kf], 


Cl 

-C 2 


Dfp 

-Df ,2 Gf, 2 \) 


(35) 


which combines the dynamics related to TZl and Ql 
in (34); 

(hi) Find a state-space realization of the system (35); 

(iv) Find a stabilizing gain L 2 for ($ 1 ,( 72 ), and then 
construct the fault estimation hlter (24) with the 
identihed system matrices in (35). 


In Step (ii), it should be noted that S in (10) includes only 
the Markov parameters {i7“} and {Hf} related to system 
inputs and outputs. According to (8) and (9), the Markov 
parameters {Hf} related to the j*'' sensor faults and {Hf} 
related to T£ in (27) can be obtained as 

/w ^ = o n-H^i] ^ = o 

- (i7f )'^' z>0^ -Hf] * > 0 ■ 

(36) 


Hf = 


Let {Gi}, {Ri} and {Qi} denote the Markov parameters 
that construct the block-Toeplitz matrices 

Gl = Tl ({GJ) ,nL = TL ({i ?*}), Ql=Tl ({QJ) 

with the dehnition of 7 l in (2). In order to ensure Gl^{^ = 
/, the Markov parameters {Gi} can be computed as 

r Go = (Hfy, 

< * ( 37 ) 

I Gi = — Gi-jHj Go, 1 < z < L — I. 

I i=i 


According to the definition oi TZl in (34), its Markov 
parameters {i?i} can be computed as the convolution of 
{Gi} in (37) and {Hf} in (36): 

R, = '^G,-jHf i = ,L-1. 

j=o 

Similarly, the Markov parameters {Qi} of Ql in (34) can 
be computed as 


Q, = Hf-Y,Hi^Rj i = 0,--- ,L-I. 
i=o 


Since the system (35) combines the dynamics of and 
Ql in (34), the Markov parameters of the system (35) are 


{Wi} with Wi 


R^ 

Q^ 


In Step (hi), using the Markov parameters (IFij of the 
system (35), it is straightforward to obtain 


Df^i Di 

-Df,2 Gf,2\ 


= 1^0 = 


Ro 

Qo 


and formulate the block Hankel matrix 


(38) 


Hw 


rWi W 2 
W2 W3 


W™ -l 


L Wt rVi+i ••• 


(39) 


which corresponds to the system (35). Then, compute the 
singular value decomposition (SVD) of Tiw, be., 


Hw — [Uw 


Evv 0 


1- 

1_ 

0 s/p 


jyw) \ 


In this above equation, the nonsingular and diagonal 
matrix T,]y consists of the fi largest singular values of the 
block Hankel matrix 'Hw^ where h is actually the selected 
order of the fault estimation Hlter (24). The order h can 
be chosen by examining the gap among the singular values 
of Hw, as in subspace identification methods (Chiuso, 
2007a). Now, we can write 


Hw = Uw^wVw- (40) 


From (40), the estimated controllability and observability 
matrices can be constructed as (Chiuso, 2007a) 

Cw = Ow = Uw^lv (41) 

Then the state-space matrices of the system (35) are 
computed as below: 

[Bf Kf] = the first n„ -I- Uy columns of Cw, (42) 

= the first Uf +ny rows of Ow, (43) 

$1 = Cw^Gfvp (Cvv.iCw.i) ) (44) 

where Cw,i and Cw ,2 are the matrices consisting of the first 
and, respectively, the last n„ (m — 1) columns of Cw- 

Finally, we follow Step (iv) by using the estimated state- 
space matrices in (38) and (42)-(44). 


Cl 

-C2. 


4-3 Comparisons and discussion 


Fault reconstruction based on dynamic latent variable 
models has been widely adopted in statistical process 
monitoring (Qin, 2012). In these types of methods, fault 
estimates are obtained by minimizing the squared recon¬ 
structed prediction error in the residual subspace of a 
latent variable model. By analyzing its close link with 
subspace identification, Qin and Li (2001) showed that 
the dimension of the residual subspace is determined by 
the left null space of the observability matrix, thus lim¬ 
iting fault reconstructability for dynamic latent variable 
models. 

Although the stabilizability condition in Theorem 1 is 
derived by using the predictor model (7), it can still be 
applied to the data-driven filter design without requiring 
the state-space model, because the invariant zeros of the 
underlying fault subsystem ($, E, G, G) can be checked by 
using the identified Markov parameters {Hf} (Yeung and 
Kwan, 1993; Fledderjohn et ah, 2010). In this sense, the 
stabilizability condition of our proposed data-driven filter 
design is the same as in model-based filter design. 

The additional design freedom for stabilization is not 
possible in the data-driven fault estimation filter design 
proposed by Dong and Verhaegen (2012), because it con¬ 
sidered only the open-loop left inverse (16) and missed the 



feedback part in the inverse dynamics. For the same rea¬ 
son, the data-driven filter in Dong and Verhaegen (2012) 
would be unstable in some situations, such as sensor faults 
of an unstable open-loop plant. In contrast, our data- 
driven design is based on the closed-loop left inverse (19) 
which guarantees the stability and unbiasedness of the con¬ 
structed fault estimation filter under the condition given 
by Theorem 1. 

The above discussion explains why sensor faults of an 
unstable open-loop plant cannot be tackled by applying 
the data-driven method in Dong and Verhaegen (2012) to 
the open-loop plant. It is worth noting that this difficulty 
cannot be solved by simply applying the same method to 
the stabilized closed-loop system. The reason is that the 
sensor faults affect not only output equations but also the 
closed-loop dynamics, hence the first equation in (36) is no 
longer valid for the Markov parameters {Hf} of the closed- 
loop fault subsystem. In fact, with only fault-free I/O data 
as stated in Assumption 3, there is no simple way to derive 
{i?/} from the identified Markov parameters {H^,Hf} 
of a closed-loop system (Wan and Ye, 2012). In order to 
use the closed-loop system for data-driven sensor fault 
estimation. Section V.B of Dong and Verhaegen (2012) 
proposed to use a special control law such that the sensor 
faults did not affect the closed-loop dynamics, which is not 
always possible in practice. 

It is also interesting to investigate the computational 
complexity of our proposed fault estimation filter (24), 
which turns out to be O {(uf + nx){nx + riu + riy)) at 
each time instant. In order to put this in perspective, we 
compare it with our recently proposed moving horizon 
fault estimator in Wan et al. (2014b), where choosing 
a certain horizon length L, the computations at each 
time instant involve multiplying a matrix of size n/ x 
L{nu + riy) with Zk,L defined in (26). This leads to a 
computational complexity of 0{Lnf{nu + ny)). Therefore, 
by directly identifying the fault estimation filter (24), our 
proposed new method would be more efficient in terms of 
computational complexity, since L needs to be sufficiently 
large in order to achieve asymptotic unbiasedness in Wan 
et al. (2014b). 

We show in Appendix B that our recently proposed moving 
horizon fault estimator in Wan et al. (2014b) can be 
equivalently rewritten as 

= Sl +-^L ~• ffc.L (45) 

which is in the same form of (29) and (30) except that 
Ql and AIl in (30) have the block-Toeplitz structure 
defined in (32) while Qj^ and AI^ in (45) are dense matrices 
according to (B.4)-(B.6). Compared to the moving horizon 
fault estimator in Wan et al. (2014b), the block-Toeplitz 
structure oiQL and A4 l in our proposed new design affects 
two aspects: 

(i) It has been proved in Wan et al. (2014a) that with 
dense matrices and A4^ in (45), the LS moving 
horizon fault estimation used in Wan et al. (2014b) 
gives minimal variance over all linear unbiased esti¬ 
mators. In contrast, the block-Toeplitz structure of 
Ql and A4 l in our proposed new method leads to 
less design freedom and minor performance loss. 


(ii) In order to ensure asymptotically unbiased estima¬ 
tion, the moving horizon fault estimator in Wan 
et al. (2014b) requires that the fault subsystem has 
no unstable transmission zeros, while a more strict 
condition is needed for our proposed new design, i.e., 
not only the transmission zeros but all the invariant 
zeros of the fault subsystem have to be stable. 

5. SIMULATION STUDIES 

Consider the linearized continuous-time VTOL (vertical 
takeoff and landing) aircraft model used in Dong and 
Verhaegen (2012). The model has four states, namely 
horizontal velocity, vertical velocity, pitch rate, and pitch 
angle. The two inputs are collective pitch control and 
longitudinal cyclic pitch control. With a sampling rate 
of 0.5 seconds, the discrete-time model (4) is obtained, 
with D = 0 and F = I 4 . The process and measurement 
noise, w{k), v{k), are zero mean white, respectively with 
a covariance of Q^u = 10“^ • I 4 and = 0.01 • l 2 - Since 
the open-loop plant is unstable, an empirical stabilizing 
output feedback controller is used, i.e., 

<k) = - [ooIo;i_o.i] ■y{k)+r^{k), (46) 

where ri{k) is the reference signal. All the parameters of 
the plant and the controller are the same as those in Dong 
and Verhaegen (2012). 

In the identification experiment, the reference signal rj{k) 
is zero-mean white noise with the covariance of diag (1,1), 
which ensures persistent excitation. We collect N = 1000 
data samples from the identification experiment. In the 
identification algorithm, the past horizon is selected as 

p = 100. 

The simulated sensor fault signals affect the first two 
sensors, i.e., E = 04 x 2 , G = [Jioq]"^, 

0<fc<50, 

I [ sin (O.lTrfc) 1 , fc > 50. 

When simulating sensor faults, the reference signal rj{k) in 
the control law (46) is set to be zero. 

We will compare the following methods for fault estimation 
filter design: 

• AlgO: design based on the accurate predictor model 

(7); 

• Algl: design based on the state-space model of the 
predictor (7) identified from data; 

• Alg2: our proposed new method in Section 4.2; 

• Alg3: our recently proposed moving horizon fault 
estimator constructed from the predictor Markov 
parameters S identified from data (Wan et ah, 2014b). 

In the state-space realization from Hankel matrices, the 
orders of the plant model in Algl and the filter in Alg2 
are both selected as 4, the same as the underlying plant. 
For Alg2 and Alg3, the order of the Markov parameters 
of the system (35) is L = 100, and the number of block 
rows and columns of the block Hankel matrix "Hw in 
(39) is I = m = 20. The poles of the first three fault 
estimation filters are placed at the same location, i.e., 
[0.948,0.532,0.225,0.141]'^. 



The method in (Dong and Verhaegen, 2012) cannot be di¬ 
rectly applied to the above sensor fault scenario due to the 
reasons explained in Section 4.3, thus it is not implemented 
here. In contrast, all the three fault estimation filters above 
are based on the closed-loop left inverse (19), and their 
stability is guaranteed since the condition in Theorem 1 is 
satisfied in this simulated scenario. 

The distributions of fault estimation errors are shown in 
Figure 2. Because of the noisy identification data and 
the model reduction errors, the three data-driven designs, 
AlgT, Alg2, and Alg3, all give larger estimation error 
covariances than AlgO based on the accurate plant model. 
Figure 2 also clearly shows that our proposed Alg2 achieves 
better estimation performance than Algl. This is because 
Alg2 is not subject to model reduction errors before 
realizing the state-space matrices in (35) as part of the 
fault estimation filter (24), while model reduction errors 
are introduced instead by Algl in the identified plant 
model, and propagated into larger uncertainties of the 
fault estimation filter. As explained at the end of Section 
4.3, Alg2 is much faster than Alg3 at the cost of minor 
performance loss. 
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Fig. 2. Distribution of fault estimation errors. Dots: 
1000 estimation errors by different fault estimation 
methods. Ellipses: the 3cr-contour of the approxi¬ 
mated two-dimensional Gaussian distribution of the 
1000 estimation errors, i.e., the contour at [/(fc) — 
fik)]'^C0Y-^{f{k))[f{k) - f{k)] = 3. 

6 . CONCLUSIONS 

A novel direct data-driven design method has been pro¬ 
posed for sensor fault estimation filters by parameteriz¬ 
ing the system-inversion-based fault estimation filter with 
Markov parameters. The proposed approach simplifies the 
design procedure by omitting the step of identifying the 
state-space plant model, and improves estimation perfor¬ 
mance by avoiding the propagation of some model reduc¬ 
tion errors into the designed filter. Moreover, it allows 
additional design freedom to stabilize the designed filter 
under the same stabilizability condition as model-based 
system inversion, thus can be applied to sensor faults in 
an unstable plants. Detailed analysis has been given to 
explain why sensor faults in an unstable plant cannot be 
tackled by applying existing state-of-the-art data-driven 
methods with predictor Markov parameters of either the 
unstable open-loop plant or the stabilized closed-loop 


system. A numerical simulation example illustrates the 
effectiveness of our method applied to sensor faults of 
an unstable aircraft system, and the advantage of the 
direct data-driven design. Future work will focus on how 
to enhance robustness against both identification errors of 
Markov parameters and model reduction errors in realizing 
the state-space form of the filter. 
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= (^(riY Ti^ (riY, (b.4) 

A4;=0;OiA(i)oI, (B.5) 

A = OlOL-OlTig'^OL. (B.6) 

Although if. ^ in (45) may be a biased estimate of fk,L due 
to column rank deficiency of 'I'l, its last Uf entries give 
an asymptotically unbiased estimate of f{k) as L goes to 
infinity (Wan et ah, 2014a). 

Note that with the innovation covariance matrix estimated 
from data (Chiuso, 2007a,b), a weighted LS problem can 
be formulated for fault estimation (Wan et ah, 2014a). For 
the sake of simplicity, an ordinary LS problem (B.2) is used 
here without loss of generality. 


Appendix A. PROOF OF THEOREM 1 


In order to prove ($i, 6 * 2 ) is stabilizable, we need to show 
that ( 4 )i,C 2 ) has no unstable unobservable modes, i.e., 

■$i - XI' 


rank 


0*2 


= n for |A| > 1. 


By following (14) and (18), it can be derived that 


$1 - A/ A 
Co G 


$- A/ A 
C G 


I 0 
-G-G I 


(A.1) 


(A.2) 


With Assumption 2, if E,C,G^ has no unstable ii 
variant zeros, it follows that 


rank 


$1 - A/ E 
G 2 G 


= rank 


^-XI E 
G G 


= n-\- Uf 


for |A| > 1, which implies (A.l). 

Appendix B. PROOE OF (45) 


With the definitions 


Ol=Ol{^,G), 'fL=[OL t{], 

the LS fault estimation problem 


x{ko) 

h,L ’ 

(B.l) 


min ||rfc,L - (B.2) 

^k,L 

can be formulated based on the second equation of (28) 
(Wan et ah, 2014a). The LS problem (B.2) has non-unique 
solutions because l may not have full column rank. By 
using the generalized inverse defined in ( 1 ), one solution 
to the problem (B.2) is 


'■k,L 






(B.3) 


According to the definition of 4'^ in (B.l) and Schur 
complements (Kailath et ah, 2000), the estimate of ik,L, 
i.e., (45), can be extracted from (B.3), with 



